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RF MOTION CAPTURE SYSTEM AND METHOD 
Cross-Reference to Related Applications 

[0001] This application is a continuation-in-part of U.S. Application Serial No. 10/386,586 
filed March 11, 2003. This application also claims priority from U.S. Provisional Application 
Serial No. 60/523,658 filed November 7, 2003. 

Background of the Invention 

[0002] 1. Field of the Invention: 

[0003] This invention relates to the field of motion capture. More particularly, this invention 
relates to the field of a radio frequency (RF) motion capture system and method. 

[0004] 2. Description of Related Art: 

[0005] The term motion capture or motion tracking refers to tracking one or more objects or 
positions on an object or objects, and quantizing and recording the objects' positions as they 
move through space. The space can be 1 -dimensional, 2-dimensional, or more commonly, 3- 
dimensional space. In many applications such as gait analysis a number of points on the object 
are to be tracked so as to effectively track, quantize, and record the linear and rotational 
movements of the component parts of the object such as the joints and limbs. Motion capture 
allows a live performance to be translated into a digital performance. Motion capture is 
becoming increasingly important in the entertainment industry, in which it is desirable to track 
many points on a person such as a stunt person and any objects which the actor may be carrying 
or are otherwise associated with the actor. Once the movements of the person's limbs and any 
associated objects have been digitally captured, the movement data can be used to digitally 
superimpose the person into a different environment, or to digitally recreate a different character 
such as a different actor or a creature performing those same or similar movements. The 
resulting digitally created images can be used in motion pictures, video games, virtual reality 
systems, and similar applications. In sports, precisely tracking movements of body parts and 
appendages can be used, for example, to analyze and correct a person's golf swing. 

[0006] A number of prior art motion tracking techniques exist. The principal technologies 
previously used for motion capture are optical, electromagnetic, and electromechanical systems. 
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Several RF systems have also been proposed or are in use. Systems based on the Global Position 
System (GPS) and its array of satellites can also be used to track the positions of objects on the 
earth such as cargo containers, although GPS based systems are relatively slow, inaccurate, 
bulky, and expensive for the types of applications for which motion capture systems are typically 
used. 

Optical Motion Capture Systems 

[0007] Optical motion capture systems generally employ reflective patches adhered or sewn to 
an actor's clothing, and a light shining on the actor. Optical cameras record the reflections from 
the patches, and a processing system processes the images recorded by the cameras to determine 
the positions of the patches as the actor moves through a scene. Examples of optical motion 
capture systems include U.S. Patent Nos. 6,580,511 entitled Wavelet-Based Facial Motion 
Capture for Avatar Animation, and U.S. Patent No. 6,567,1 16 entitled Multiple Object Tracking 
System. The former patent incorporates wavelet transforms for feature detection and tracking. 
Optical motion tracking systems are limited to line-of-sight operation. Once a particular patch 
has been hidden from view by an actor's movement and the patch then reemerges into view, an 
operator must generally identify for the system by hand the reappeared patch. 

Electromagnetic Trackers 

[0008] Electromagnetic trackers generally work on the principle that a tag creates an 
electromagnetic field around it, or induces disturbances in an electromagnetic field which has 
been induced across the capture zone. Examples of Magnetic Field motion capture systems 
include U.S. Patent Nos. 6,549,004 entitled Distributed Magnetic Field Positioning System 
Using Code Division Multiple Access, and U.S. Patent No. 6,400,139 entitled Methods and 
Apparatus for Electromagnetic Position and Orientation Tracking with Distortion Compensation. 
The former patent uses code division multiple access (CDMA) to distinguish between beacons, 
purportedly allowing for larger capture zones and reduced interference. 
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Electromechanical Devices and Suits 

[0009] Electromechanical devices and suits generally employ electromechanical sensors such 
as potentiometers to capture movements such as rotations of joints. The sensors can be 
connected by wires to the processing system, or the output of the sensors can be transmitted via a 
wireless connection. Electromechanical suits have been widely used in virtual reality simulation 
systems. Examples of electromechanical motion tracking systems include U.S. Patent No. 
6,563,107 entitled Topological and Motion Measuring Tool, and U.S. Patent No. 6,070,269 
entilted Data-Suit for Real-Time Computer Animation and Virtual Reality Applications. 
Electromechanical systems are often bulky and obtrusive, and are not well suited for tracking the 
relative movement of independent objects. 

Radio Frequency Systems 

[00010] Several radio frequency (RF) systems have also been proposed. U.S. Patent No. 
6,204,813 purports to describe a radio frequency positioning system that determines identity and 
positional data of numerous objects. The system includes a plurality of spread-spectrum radio 
transceivers where at least one transceiver is positioned on each of the numerous objects. At least 
three spread-spectrum radio transceivers transmit to and receive signals from the plurality of 
radio transceivers. A signal processor is coupled to the spread-spectrum radio transceivers and 
determines the identity and the positional data of the objects. 

[0001 1] U.S. Pat. No. 5,583,517 is directed to a multi-path resistant frequency-hopped spread- 
spectrum mobile location system. The frequency-hopped spread-spectrum mobile vehicle or 
person location system consists of a central station, a plurality of base stations and a plurality of 
mobile transmitters which transmit using a frequency-hopped spread-spectrum differential bi- 
phase shift keying (BPSK) communication signal. Each of the plurality of base stations includes 
an array of receiving dipole antennas and employs a special algorithm for retrieving very low 
power frequency-hopped spread-spectrum signals in a noisy and multi-path environment. The 
base stations use computational algorithms for determining the phase difference between each of 
the receiving dipole antennas to determine the direction of the transmitter relative to the location 
of the respective base station. The multiple directions of arrival angles of the received signal at 
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each base station are corrected based on an n-dimensional ambiguity space to locate the most 
probable angles of arrival. 

[00012] U.S. Patent No. 5,5 1 3,854 describes a system in which each player on a field carries a 
miniaturized radio frequency transmitter. A set of at least three radio frequency goniometric 
receivers determines the direction from which the transmitters transmit. A digital processor uses 
triangulation methods to determine the position of the transmitters. 

[00013] U.S. Patent No. 5,438,321 describes a location system for tracking miners 
underground. The system includes a number of identification stations connected to a central 
control station. Miners are issued portable identification modules which are fitted to their 
caplamps. The identification modules transmit unique identification signals at intervals, which 
are picked up by the identification stations. Miners who are issued a caplamp first pass an 
identification card through a reader which reads a unique personal identification code from the 
card. The system includes a direction finding receiver adapted to receive and display the 
identification code transmitted by the identification module of a lost miner. 

[00014] U.S. Patent No. 5,056,106 describes a system which employs a spread-spectrum based 
radiolocation system, using hand-held receiver units and fixed-position reference transmitters, to 
determine distance and direction between a golfer and key locations on a golf course. The 
plurality of timing reference transmitters which are located throughout the vicinity of the golf 
course broadcast a spread-spectrum ranging signal consisting of a radio-frequency carrier 
directly modulated by a periodic pseudo-noise (PN) coded or similar sequence. Each transmitter 
broadcasts at the same RF signal but a unique PN-coded sequence is assigned to each transmitter. 
Golfers are provided with the hand-held receiving unit which receives the transmitter spread- 
spectrum signals and which synchronizes to the spread-spectrum signals in order to obtain range 
estimates to a selected set of reference transmitters. 

[00015] U.S. Patent No. 4,660,039 describes a system for locating a sport object. The user 
carries a radiofrequency transmitter, and the sport object has a conductive stripe which has an 
effective length of XI A at the signal frequency so that the conductive stripe increases the load on 
the transmitter as the transmitter moves closer to the sport object. 
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Invention Summary 

[00016] The present invention provides an improved RF motion tracking system that provides 
various advantages over prior art systems. In one aspect the invention is of a motion capture 
system. According to this first aspect, in a preferred embodiment the invention includes 
preferably at least four stationary radio frequency receivers defining sensors that are placed at 
known locations around or about an area to define a capture zone, at least one stationary radio 
frequency transmitter defining a reference tag, and a number of radio frequency transmitters 
defining marker tags that are placed onto one or more objects to be tracked. A processing system 
processes the signals received by the sensors. The signals are spread-spectrum RF signals. The 
positions of the reference tag relative to the sensors can be determined using direct 
measurements or can be determined using various possible calibration procedures and techniques 
which do not rely upon direct measurements. The capture zone should be at least within the 
reception range of all of the receivers. 

[00017] Once the position of the reference tag is determined relative to the sensors, digital 
samples from the sensors are processed to extract a pseudorange measurement between each tag 
and each sensor. The measurements are pseudoranges, as opposed to ranges, because they 
contain a time term as well as a distance term. These measurements are differenced between the 
marker tags and the reference tag, and the resulting single differences are differenced between 
sensors to form double differences. The double differences are processed to determine the 
marker tag positions at each measurement time relative to the reference tag position. 
Equivalently, the position of each of the marker tags can be determined relative to a locus within 
any frame of reference including each other, the sensors positions, or any arbitrary coordinate 
system, using known mathematical coordinate transformations. Because the algorithms used to 
process the signals from the reference tag and marker tags cause the clock-dependent terms to 
drop out, the positions of the marker tags can be determined to a very high degree of accuracy 
without requiring clocks to be synchronized between sensors, between tags, or between sensors 
and tags. 

[0001 8] The signals transmitted by the tags are code sequences modulated on a carrier 
frequency and spread using direct-sequence spread-spectrum techniques. The code sequences 
include a synchronization code, which is common to all tags, and a tag identification code, which 
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is unique to each tag. In a preferred embodiment the synchronization code is the 16-bit Neuman- 
Hofman sync word OEED hex having good autocorrelation characteristics. The tag identification 
codes are chosen to minimize pairwise cross-correlation. Those codes are randomly chosen 
vectors in the binary extended quadratic residue code space. The processing system uses code 
phase and carrier phase determinations to resolve the positions of the tags to within a fraction of 
a wavelength. The transmitters transmit microbursts of code such that the transmitters are 
transmitting less than 5% of the time, less than 1% of the time, and in the exemplary 
embodiment approximately 0.2% of the time. This small duty cycle minimizes battery drain at 
the transmitters and reduces the likelihood of collisions. The transmission rate is preferably an 
integer multiple of both 24 per second and 30 per second, and more preferably 240 per second. 
This ensures that motion can be captured at a frame rate that is equal to either 24 frames per 
second or 30 frames per second, which are standard frame rates used within the entertainment 
industry. 

[00019] In the processing system, the received waveform representing the tag identification 
codes is not demodulated to a bit stream of ones and zeroes with the binary code value then 
looked up via a look up table. Rather, the digital samples representing the received tag 
identification code waveform are processed through a correlator implemented within a Digital 
Signal Processor (DSP). The tag identification code is determined by autocorrelating candidate 
tag code waveforms to the received waveform. 

[00020] Simulations indicate that the system will be able to track up to five thousand tags 
within a capture zone of up to 125 meters diagonal, with sub-millimeter accuracy. More 
generally, this means that the system will be able to resolve positions of at least 100 tags to 
within 1 cm of accuracy over a capture zone having a diagonal of at least 50 meters. This also 
means that the system will be able to resolve positions of at least 1000 transmitters to less than 1 
cm of accuracy over a capture zone of at least 75 meters. 

[00021] In another aspect, the invention is of a flexible RF patch tag that, when a protective 
cover or layer is removed, automatically turns itself on and begins transmitting. Visual, audio, or 
other feedback can be provided to verify that the tag is active and transmitting. In one 
embodiment the patch transmitter is a small round flexible patch having several thin layers, 
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including a backing layer, an adhesive coating, a battery layer, a circuitry layer, an antenna layer, 
and a protective layer. The device may be covered by a paper or film layer covering the 
adhesive layer, with removal of the paper layer causing electrical power contacts to close thus 
activating the device. At the same time, removal of the paper layer causes the adhesive to be 
exposed so that the tag can be adhered directly to the object to be tracked. The patch tag is small 
enough to be adhered to a large number of positions on human skin or clothing while allowing 
substantially full movement of the person. 

[00022] The motion capture system of the present invention can be utilized in any application 
in which it is desirable to know the positions of objects within a reference frame, and particularly 
in applications in which it is desirable to know the positions of many quickly moving points on 
an object or many separate objects. 

[00023] In another aspect, the invention is of a match moving system which utilizes the RF 
motion capture system described to track movements of a motion picture camera and perform 
post-processing on the recorded moving picture image in accordance with the tracked position 
and attitude of the camera. In this aspect of the invention, at least three marker tags are placed 
on a motion picture camera such as a hand held motion picture camera. The marker tags are 
placed in non-planar positions on the camera such that the locations of the three tags completely 
determines the camera's spatial position as well as its pitch, yaw, and roll angles. The camera 
records a scene while the camera is moving, such as by being hand carried by the camera 
operator. Because the exact position and attitude of the camera is precisely recorded by the RF 
motion tracking system, the resulting image can later be post-processed to achieve a number of 
desirable effects. 

[00024] In one example, the recorded scene can be post-processed to insert a digital computer 
generated image (CG) image into the scene. As the camera pans horizontally or vertically 
around the scene, moves forward or backwards, rotates, pitches, or performs any other motion, 
the CG image can be altered to match the motion of the camera. The appearance of the CG 
image changes exactly as one would expect an image of an object physically present in the scene 
to change as the camera moves. The result is a realistic CG image within a motion picture while 
substantially reducing manual correlating and manipulating of the CG image as was required in 
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certain prior art systems. In another example, the match moving system allows the recorded 
image to be post-processed to remove camera jitter, that is, to remove from the recorded image 
the effects of small motions of the camera so that to the viewer the camera appears to have been 
held steady, although possibly moving, throughout the filming of the scene. 

[00025] Although the system can theoretically be combined with other position determining 
techniques such as GPS, inertial sensors, and electromechanical sensors for use in some 
applications, for most intended applications the system will operate without any other 
positioning determining methods. 

[00026] Exemplary embodiments of the invention will be further described below with 
reference to the drawings, in which like numbers refer to like parts. 

Brief Description of the Drawings 

[00027] FIG. 1 is a generalized system diagram of the motion capture system of the present 
invention. 

[00028] FIG. 2 is a diagram illustrating how the present invention can be used with a motion 
picture camera as part of a match moving system. 

[00029] FIG. 3 illustrates placement of sensors in an exemplary 4-sensor embodiment. 
[00030] FIG. 4 illustrates placement of sensors in an exemplary 8-sensor embodiment. 
[0003 1] FIG. 5 is a frequency plan diagram for the tag transmissions. 
[00032] FIG. 6 illustrates a transmission packet structure. 

[00033] FIG. 7 is an autocorrelation diagram showing the autocorrelation of the sync word 
used in a preferred embodiment. 

[00034] FIG. 8 illustrates a simple shift register generator used to generate transmission 
sequences. 

[00035] FIG. 9 is an autocorrelation diagram showing the autocorrelation of the 640-bit PN 
sequence transmitted by a tag in one embodiment of the present invention. 
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[00036] FIG. 10 is a system interface functional diagram. 
[00037] FIG. 1 1 is a functional diagram of a first tag embodiment. 
[00038] FIG. 12 is a functional diagram of second tag embodiment. 

[00039] FIG. 13 is a schematic diagram of an exemplary tag controller circuit according to a 
first tag controller embodiment. 

[00040] FIG. 14 is a schematic diagram of exemplary tag controller circuitry according to a 
second tag controller embodiment. 

[00041] FIG. 15 is a functional block diagram of a sensor. 

[00042] FIG. 16 is a functional block diagram of the processor for processing received tag 
signals. 

[00043] FIG. 17 is a diagram illustrating predicted carrier phase multipath error for a preferred 
embodiment. 

[00044] FIG. 18 is a functional block diagram of a correlation bank implemented within the 
processor. 

[00045] FIG. 19 is a simple shift register generator used to generate tag transmissions 
according to a second system embodiment. 

[00046] FIG. 20 is a functional block diagram of a tag according to a third tag embodiment 
used in the second system embodiment. 

[00047] FIG. 21 is a schematic diagram of an exemplary tag controller circuit according to a 
third tag controller embodiment used in the second system embodiment. 

[00048] FIG. 22 is a functional block diagram of a sensor according to the second system 
embodiment. 

[00049] FIG. 23 is a sensor DSP processing functional block diagram according to the second 
system embodiment. 
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[00050] FIG. 24 is a functional block diagram of the processor for processing received tag 
signals according to the second system embodiment. 

[0005 1 ] FIG. 25 is a tag position resampling plot. 

[00052] FIG. 26 illustrates how the system can be used to create an extended capture zone by 
overlapping individual captures zones. 

[00053] FIG. 27 is a side perspective view of a patch tag according to one aspect of the present 
invention. 

Detailed Description of the Preferred Embodiments 

[00054] With reference to FIG. 1, a radio frequency (RF) position tracking system 40 
according to a first aspect of the present invention consists of three subsystems: active RF tags or 
simply tags, passive sensors 42, and processing equipment or simply the processor 60. The 
system 40 employs two different types of tags: one or more reference tags 50 and one or more 
marker tags 52. Reference tag 50 and marker tags 52 can be identical in construction. They 
differ primarily in their placement and use. In a preferred embodiment, a plurality of marker tags 
52 are placed on an object 54 to be tracked such as the person illustrated in the figure, as well as 
any appendages 56 such as a gun or a sword being carried by the person. For an object having a 
large number of constituent parts and possible movements such as a human being, preferably a 
large number of marker tags 52 are placed on the person's respective limbs and joints such that 
tracking movements of the individual marker tags 52 results in a complete or nearly complete 
record of the object's various movements. Multiple objects can be tagged and tracked. For 
example, two humans engaged in a sword fight can be tracked, with the resulting digital 
performance stored and later transformed into a sword fight between two alien creatures. The 
object(s) and the reference tag are placed within a motion capture zone or simply capture zone, 
within an area bounded by sensors 42. The capture zone generally lies within, but does not 
necessarily completely occupy, the area bounded by sensors 42, as there may be a buffer area 
between the capture zone and sensors 42. Marker tags 52 and reference tag 50 transmit RF 
signals, preferably direct-sequence spread-spectrum signals. The signal sensors 42 are receivers 
that receive the RF signals transmitted by the tags. 
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[00055] The signal from each marker tag 52 and reference tag 50 is uniquely encoded to 
distinguish between the individual tags. A minimum of four sensors 42 are placed around the 
periphery of the capture zone. Sensors 42 digitize (sample and quantize) the received signal 
band. Digital samples from sensors 42 are processed to extract a pseudorange measurement 
between each tag 50 or 52 and each sensor 42. The measurements are pseudorange, as opposed 
to range, because they contain a time term. These pseudorange measurements are differenced 
between the marker tags 52 and the reference tag 50, and the resulting single differences are 
differenced between sensors to form double differences. The double differences are processed to 
determine the marker tag 52 positions at each measurement time relative to the reference tag 50 
position. This raw position information is output for each marker tag 52. 

[00056] FIG. 2 illustrates one specialized application for the invention in which the object to be 
tracked is a motion picture camera 57. Camera 57 has a plurality of marker tags 52 affixed 
thereto or otherwise associated therewith. Preferably camera 57 has at least three marker tags 
affixed thereto in a non-linear and non-planar spatial relationship so that movements of the 
camera can be completely captured including the x,y,z position of at least one point on the 
camera as well as its pitch, roll, and yaw. In this application the system is used as part of a 
match moving system. The match moving system can be used for generation of computer 
generated objects or for removal of camera jitter. 

Processing Algorithms 

[00057] In the discussion which follows, the designator A will refer to an arbitrary marker tag 
52, the designator R will refer to a reference tag 50, and the designator i will refer to an arbitrary 
sensor 42, for convenience of mathematical development without reference to any particular 
figure herein. 

[00058] The double difference measurements are formed using pseudorange measurements 
from marker tag, A, and from reference tag, R, to each of the sensors. At the n-th measurement 
time, reference tag R is located at (0,0,0) with clock T R (n), and Marker Tag A is located at r A (n) 
= [^xin), r A Y (n), r A z (n)] T with clock T A (n). Multiple sensors receive the RF signals from A and 
R. Sensor i is located at known position Sj = [six, Sj Y , Siz] and is stationary with clock Tj(n). Then 
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the measurement equations for the marker A and reference tag R pseudoranges (PRs) at sensor i 
are given by 

PRf(n) = yj(r A x (n) - s iX ) 2 + (r A r (n) - s iY ) 2 + (r A z (n)- s iZ ) 2 - c(T A (#i) - J,(n)) 
= |r A (/i)-s i |-c(r(«)-7;.(n)) 

/># (») = Js lx 2 +s ir 2 +s lz 2 - c(T R (n) - = |s, | - c(r» - 2J(»)) 

where 

[00059] Single differences between the marker tag A and reference tag R pseudorange 
measurements eliminates the sensor clock term 

PR? (n) - PR? («) = |r A (w)-s.|-|s i |- c(r^ (h) - 7* (»)) 

[00060] Double differences between sensors i's and j's single differences eliminates tag related 
clocks terms 

8PR^{n) = PR?{n)-PR?(n)-PR*{n) + PR*^ 

[00061] Combining the terms independent of the marker tag A position on the left side gives: 

SPRf (n) + |s.|-|s j | = |r A («)-s i |-|r A («)-s j | 

[00062] The three unknowns are the marker tag, A, position coordinates, r A x (n), r A Y (n), and 
r A z (n), at time n. Measurements from four sensors 42 are required to form the three independent 
double differences required to obtain three independent equations in these three unknowns. The 
resulting equations can be solved directly for the marker tag A coordinates. Alternatively, the 
equations can be linearized around an approximate solution and the resulting linear equations 
solved for the marker tag A coordinates. The direct solution can also be used as the approximate 
solution for linearization. 
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[00063] Given single difference measurements from four sensors, the direct solution can be 
calculated as follows, where so, S|, $2, and S3 are the position vectors for the four sensors relative 
to the reference tag R; and 8PRoi AR , 8PRo 2 AR , and 5PRo 3 AR are the three scalar double 
differences. 

p k = 8PRok AR + |so| - |Sk|, k = 1, 2, 3 {reorder if necessary such that p ( * 0, 

further, if Pk = -|puj for any k, reorder such that Pi = -|pi|} 

Pk = s k -s 0 , k= 1,2, 3 
n, -P2P1 -P1P2 
n2 = p3Pi~PiP3 

a, = pip 2 (p 2 - pi) + P1P2KP1 - P2) 
a 2 = p,p 3 (P3-P.) + PiP3-(Pi-P3) 
Y = PiPi T - Pi 2 I 3 {I 3 is the 3 x 3 identity matrix} 

♦ -PiW-Pi 2 ) 

n = n ( x n2 {vector cross-product, |n| > 0 for non-planar satellite geometry} 

X] =ai|n 2 | 2 -a 2 ni'n 2 )/|n| 2 

A. 2 = a 2 |n 2 | 2 -aini»n2)/|n| 2 

q = A,ini + X2112 

a = n T Yn 

co = (r T Yr-(|))/a 

k = n T Yr/a 

G = -K±[K 2 -(0] 1/2 

w - 0n + q, check Pi(pi»w) < 0 

r A = X A [w + Si - So] {position vector of tag A relative to reference tag R} 
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[00064] For (M+l) sensors, M > 3, the generalized least squares solution for marker tag A 
position relative to the reference tag is given by: 



where 



r A (n) = r°(n) + 5/ 



r°(n) is an approximate solution for the marker tag A position vector 

5PR$(ri) - |r» - s 0 | + |r°(«) - s, | + |s 0 | - |s, | 
SPRg («) - |r°( W ) - s, I + |r°(«) - s 2 1 + ]s, | - |s 2 | 



6z = 



8pr£„« (») - k°(«) - s M I + k» - s m + . |+I s m|- K» I 



Mx 1 
measurement 
vector 



H = 



axf 2 (n) 



ayf 2 {n) 



azf 2 (n) 



ccxh 



{M x 3 observation matrix} 



r°An)- 



jX 



r°(«)- Sj | r°(«)- Sj 



r° Y (n)-s ir r° r (n)-Sj 



r°(n)-s,| |r°(n)-s.| 

a, \ r° z (n)-s l2 r\(n)-s z 



For improved accuracy, these equations can be iterated as follows: 

1. Given initial marker A estimated position vector, r°(n), sensor location vectors, 
Si's, and double differences, compute 5PRij AR 's. 

2. Compute the measurement vector, Sz. 

3. Compute the linearized observation matrix, H n . 

4. Compute the error state vector, Sr. 
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5. Update the marker tag A estimated position vector r A (n). 

6. Repeat from step 2, using the updated position vector as the new estimated 
position vector, until the computed error state vector is sufficiently small. 

The covariance of the error state estimate is given by 

E[5r5r T ] = (Hn T H n )" l H n T E[8z8z T ]H n (H n T H n )" T 

[00065] Assuming that the individual pseudorange measurement errors are i.i.d. (independently 
identically distributed) with variance g m , then the error covariance matrix is given by: 

E[5r5r T ] = 4 (H/H^^GHn (H n T H n )' T cr M 2 

where 




[00066] The effect of the sensor-tag geometry is position dilution of precision, PDOP, which is 
computed as 

PDOP = {tracetCHnXX^n^Hn (H n T H n )' T ]} l/2 
[00067] PDOP can be decomposed into vertical and horizontal components 

PDOP 2 = HDOP 2 + VDOP 2 

[00068] Preferably the system uses at least 4 sensors 42, as illustrated in one exemplary 
4-sensor arrangement in FIG. 3. More sensors, such as in the exemplary 8-sensor arrangement 
shown in FIG. 4 are possible. Generally speaking, the greater the number of sensors 42 the 
lower the PDOP. The number of sensors and tags used in order to obtain greater precision, 
however, must be balanced against practical considerations including processing power and 
throughput. 



[00069] When pseudorange measurements from 5 or more sensors are available, it is possible to 
detect when the 4 independent double differences are inconsistent. With pseudorange 
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measurements from 6 or more sensors, it is possible to identify 1 erroneous double difference 
measurement. In general, with (M+l) sensors it is possible to identify up to (M-4) erroneous 
measurements. Erroneous measurements can arise as the result of multipath, variations in the 
radio refractive index, interference, and equipment errors. The M x 1 fault vector, f, is computed 



S - Im - H n (H n T H n ) 
f=Sz 

[00070] If the decision variable exceeds a threshold, then the M double difference 
measurements are not consistent. If M is greater than or equal to 5, then (M-4) faulty 
measurement(s) can be identified by finding the index(s), i, that maximize fj 2 / S\\. 

[00071] The threshold, T, for (M+l) Sensors is computed as 



as: 



T = 4a M 2 Q-\P FA \M-3) 



where 



ctm 2 is the pseudorange measurement variance 



Pfa is the acceptable false alarm rate 



Q" (x,n) is the inverse of 




0 



[00072] The probability of missed detection is calculated using 




where 



P(x\n,0) = f^e- e/2 




P(x\n + 2j) 
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B is the acceptable measurement error. 



[00073] An alternate algorithm for processing the double differences to determine the marker 
tag positions relative to the reference tag is the extended Kalman filter. The marker tag motion is 
modeled as driven by white noise acceleration, the system model is: 



where 



x(*) = 0>x(Jfc-l) + w(*) 

x(k) = [r(£) 7 y(k) T a(Jfc) r J {9 x 1 state vector} 

r(k) is the Marker Tag position vector 
v(k) is the Marker Tag velocity vector 
a(k) is the Marker Tag acceleration vector 
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9x9 

state transition 
matrix 



AT is interval between measurements k and k+1 (nominally 0.004167 sec). 
E[w(k)] = 0 
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Q = E[w(k)yv(k)'] = a 



0 0000000 0" 
000000000 
000000000 
000000000 
000000000 
000000000 
000000100 
000000010 
0 0000000 1_ 

<ta is the modeled acceleration noise standard deviation (nominally 2.25 m/sec 2 ) 
[00074] The measurement model is 



9x9 

state noise 
covariance matrix 



Sz(k) = H(k)Sx(k) + \(k) 



where 



bz(k) = 



SPRt* (k) - \r(k) - s 0 1 + \r(k) - s, | + |s 0 1 - |s, | 
SPR?*(k) - \r(k) - s, | + \r(k) - s 2 | + js, | - |s 2 | 



SPR£ M « (*) - \m - s M | + \r{k) - s M+1 1 + |s M | - |s, 



M + l| 



Mx 1 



measurement vector 



ax^(k) ay^(k) az^(k) 0 0 0 0 0 0 
axf 2 (k) ayf 2 (k) 



azf 2 (k) 0 0 0 0 0 0 



(*) ccy A MM+x {k) az A MM+l (k) 0 0 0 0 0 0 



Mx9 
observation matrix 



£[v(*)] = 0 
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/? = £[v(*)v(*)'] = 4<4 



- 1/ 



_ 1/ 



o -V 



0 
0 



0 
0 



0 

~y. 

1 

• 

0 
0 



0 

0 

0 
• 

1 

. 1/ 



0 
0 
0 

• 

1 



MxM 
measurement 
noise covariance 
matrix 



crpR is the pseudo-range standard deviation (nominally 3.5 m for code phase based 
measurements, and 0.00025 m for carrier phase based measurements) 

[00075] The time update equations are 

x(k) = Ox + (k-l) 

P^OP^tf+Q 
and the measurement update equations are 

K k = P-H k r [H k P~H k T +R] X 

P\ =[I- K k H k ]P k - [I - K k H k f + K k RK k T 
x + (k) = x(k) + K k Sz(k) 

[00076] The state covariance matrix, P, is initialized based on the uncertainty in the marker 
tag's position. 

[00077] The extended Kalman filter can be iterated for improved performance. The three 
measurement update equations are iterated with the error measurement vector and the 
observation matrix recalculated using the most recent state estimate at the start of that iteration. 

[00078] The concept described in this section can be implemented using a broad spectrum of 
radiofrequencies. However, the most likely frequencies are in the range from 0.3 GHz to 300 
GHz. This range includes the UHF (0.3 GHz - 3 GHz), SHF (3 GHz - 30 GHz), and EHF (30 
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GHz to 300 GHz) bands. The concept can be implemented with a variety of techniques for 
obtaining the pseudorange measurements. 

First Exemplary System Embodiment 

[00079] In a first exemplary system embodiment, tags 50 and 52 transmit direct-sequence 
spread-spectrum microwave signal bursts. Sensors 42 down-convert and analog-to-digital (A/D) 
sample the received signal band. Digital samples from sensors 42 are processed to extract code 
pseudorange and carrier pseudorange measurements for each of the tags 50 and 52. These 
pseudorange measurements are processed to determine the tag positions at each sampling instant. 

[00080] According to simulation results, the system is expected to operate with a capture zone 
of 130 m x 55 m x 10 m and can capture the positions of tags 52 anywhere within the zone. The 
minimum preferred sensor configuration is 8 sensors, one each near each of the vertices of the 
capture zone. Up to an additional 24 sensors placed around the periphery of the capture zone 
provide enhanced performance. Sensors 42 are setback such that there is approximately 5 to 1 5 
meters between the front of a sensor and the capture zone. Tags 50 and 52 are generally excluded 
from a volume defined by a plane tangent to the capture zone at its closest point to a sensor and a 
parallel plane twice the setback distance of the sensor away from the closes point of the capture 
zone. 

[00081] The system is designed to operate with up to 5,000 tags in the capture zone, and to 
provide full accuracy for tag dynamics up to 4.5 m/s velocity per axis, 0.45 m/s 2 acceleration per 
axis, and 0.45 m/s 3 jerk per axis. Reduced accuracy is provided for dynamics up to 45 m/s 
velocity per axis, 4.5 m/s 2 acceleration per axis, and 4.5 m/s 3 jerk per axis. The system provides a 
90% probability of capturing each individual tag within the capture zone which has an 
unobstructed line-of-sight to a minimum of 4 sensors. 

[00082] According to simulations, the system provides marker tag position outputs in X, Y, Z 
local level coordinates relative to the location of fixed reference tag 50 placed within the capture 
zone. The position latency does not exceed 0.1 seconds. The position output rate for each marker 
tag 52 is preferably selectable from 1, 2, 3, 4, 5, 6, 8, 10, 12, 15, 16, 20, 24, 30, 40, 48, 60, 80, 
120, and 240 per second. In a preferred embodiment the output rate is an integer multiple of both 
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24 and 30, such as 240, for convenient compatibility with frame rates commonly used within the 
entertainment industry. Output accuracy is 1-mm 1-sigma per axis during periods of limited 
dynamics, and 10-mm 1-sigma per axis during periods of high dynamics. The output precision is 
1-mm per axis. 

[00083] The total output data rate of the system with 5,000 tags in the capture zone is 9 
MBytes/sec of unformatted data or 10.8 MBytes/sec with data formatted to byte boundaries. The 
position data for each tag can be formatted as 17-bits of X-position, 16-bits of Y-position, 14-bits 
of Z-position, and 13-bits of tag ID. With byte boundary formatting the output position consists 
of 3-bytes of X-position, 2-bytes of Y-position, 2-bytes of Z-position, and 2-bytes of tag ID. 

[00084] Sensors 42 generate digital samples with a timing accuracy of 67 microseconds. They 
have a minimum 29 dB RF input dynamic range, and their antennas provide a field of view 
covering the entire capture zone. 

[00085] FIG. 5 illustrates the frequency band within which the first exemplary system 
embodiment operates. This embodiment operates in the 5.725 - 5.850 GHz frequency band. 
This frequency band 60 is divided into 8 sub channels, A through H. Each operational sub 
channel 62, 64, 66, 68, 70, 72, 74, and 76 is 10 MHz wide and separated by 5 MHz guard bands 
61, 63, 65, 67, 69, 71, 73, 75, and 77. 

[00086] FIG. 6 illustrates a transmission packet structure for this embodiment. Each packet 80 
includes a 16-bit sync word 82 which is common to each tag. The sync word 82 is chosen for its 
autocorrelation properties. In the preferred embodiment the 16-bit Neuman-Hofrnan sync word 
0EED hex (00001 1 1011101101 binary) was chosen and is used for all packets. This sync pattern 
has excellent autocorrelation properties as shown in FIG. 7. Other sync words could be used 
instead of the particular sync word chosen. Furthermore, it is not necessary that all of the tags 
transmit the same sync word, but using the same sync word has the advantage of convenience 
and allows a good sync word to be used for each tag. Still further, sync words having other 
numbers of bits could be chosen. 



[00087] Packet 80 also includes a 48-bit tag ID field 84 which is unique to each tag. The 
unique tag ID for each tag allows the system to distinguish among and automatically track 
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individual tags. With prior art optical reflective tags, when a tag became obscured from the sight 
of the camera and then reemerged, a system operator needed to identify by hand for the 
processing system which tag(s) had reappeared and in which position(s). This requirement is 
eliminated by having each tag emit a unique tag ID code. The tag ID could either be hard wired 
into the die by various techniques such as by laser vaporization of fuses, or could be 
programmable via various techniques such as EEPROM, battery backed up RAM, FRAM, 
UVPROM, and the like. 

[00088] The tag ED is selected as an arbitrary vector in the [48, 24, 12] binary extended 
quadratic residue code space. This ensures that all code vectors differ in a minimum of 12 bit 
positions. The tags do not require an encoder; rather, the tag ID is precomputed and stored in the 
tag. Also, the sensors do not require decoders since the tags are identified by cross-correlation 
with prestored patterns. The code generator polynomial is: 

Y[(x-a n ) 

where Q = {1,2,3,4,6,7,8,9,12,14,16,17,18,21,24,25,27,28,32,34,36,37,42}, and the LSB 
of the tag ID is computed such that modulo-2 sum of the first 47 bits plus the LSB is 0. 

[00089] The tag code can also be identified on the tag itself or on tag packaging by a written tag 
ID, a bar code, or other human- or machine-readable encoding mechanism on the tag. A bar 
code on each tag, for example, would allow the tag to be scanned by a handheld or stationary bar 
code reader as part of the process by which the operator identifies once in the process where each 
tag is used on which part of which object to be tracked. Scanning bar codes representing tag ID 
codes also enables the system operator to ensure that no two tags having the same tag ID are 
simultaneously used within the same capture zone. 

[00090] The multiple access architecture in this exemplary system embodiment is a 
combination of FDMA (frequency division multiple access) and SSMA (spread-spectrum 
multiple access). The tags are evenly divided among the 8 different frequency channels. All 
bursts in each channel are spread using the same 640-chip segment of a long pseudonoise (PN) 
code which has good autocorrelation properties. Collisions between packets only occur if the 
first chip of one burst in a channel overlaps the first chip of any other burst in that channel at the 
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sensor. The probability of a collision occurring is Pc = 1 - e* T where t is the chip duration (100 
nsec) and X is channel rate (bursts/sec). For example, with 1 channel and X = 1.2 million 
bursts/sec the collision probability is Pc = 21%. With 2 channels the bursts/sec per channel are 
reduced to X = 0.6 million, and Pc = 11%. With 4 channels, X = 0.3 million bursts/sec/channel 
and Pc = 5.8%. With 8 channels, X = 0.15 million bursts/sec/channel and Pc = 3.1%. Hence, with 
8 channels and 240 measurements per second per tag, an average of 7.4 measurements per 
second per tag are lost due to collisions. 

[00091] FIG. 8 illustrates the simple shift register generator for generating the 640-chip PN 
segment. The segment is generated from ca 19-stage simple shift register generator (SSRG) with 
maximal length feedback polynomial x 19 + x 5 + x 2 + x and initial condition 0EEDA hex 
(0001 1 1011101101 1010 binary). The SSRG exclusive OR's the bits in 19 th , 5 th , 2 nd , and 1 st 
stages to generate an input to the 1 st stage. The bits are then shifted one stage to the left. The bit 
in the leftmost stage, the 19 th , is output.The first 640 bits are used. The first 40-bits are 
7DBA98EEDA hex. 

[00092] FIG. 9 illustrates the autocorrelation for the 640-bit PN sequence. 

[00093] The carrier is Gaussian Minimum Shift Keying (GMSK) modulated by the 10 Mbps 
chip sequence with a bandwidth time product (BT) = 0.3. The link budget is given in Table 1 
below: 
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Table 1 - Link Budget 



5.8 GHz 



Peak Transmit Power (dBW) 

Peak Transmit Power (mW) 
Feed Loss (dB) 

Transmit Antenna Peak Gain (dB) 




EIRP (dBW) 

Free Space Loss (dB) 

Frequency (GHz) < 

Path Lenght (Km) 
Polarization Loss (dB) 
Gaseous Loss (dB) 

Rain Loss @ 99.9% Rain Avalibility (dB) 



Total Transmission Loss (dB) 

Receive Antenna Peak Gain (dB) 
Polarization Mismatch Loss (dB) 
Transmit Ant Axial Ratio (dB) 
Receive Ant Axial Ratio (dB) 
Pointing Loss (dB) 

System Noise Temp @ Antenna (dB-°K) 
Feed Loss (dB) 
Receiver Noise Figure (dB) 
Antenna Temperature (°K) 
Receiver/Feed Noise Temp (°K) 
System Noise Temp @ Ant (°K) 




G/T (dB/°K) 



-24.6 



Available C/No (dB-Hz) 

Information Rate (dB-Mbps) 

Information Rate (Mbps) 
Required Eb/No (dB) 
Implementation Loss (dB) 



73.7 




Required C/No (dB-Hz) 



Unallocated Margin (dB) 



5.7 



[00094] FIG. 10 is an interface functional diagram showing the functional interface between 
marker tag 52, sensor 42, and processor 62. Each tag 52 periodically emits a data packet 
modulated on a 5.8 GHz RF carrier. Sensors 42 receive and demodulate the packets from the tags 
52, and process them to extract the tag ID, code phase, and carrier phase. This data is provided to 
processor 62 at a rate of 1 .2 million measurements per second per sensor. The processor 
processes the measurements to determine X, Y, and Z position coordinates for each tag, a total of 
1 .2 million positions per second. 
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[00095] FIG. 11 is a functional block diagram of a first tag embodiment for the first system 
embodiment. Crystal oscillator (XO) 1112 generates a reference carrier. A phase-lock-loop 
(PLL), consisting of a phase/frequency detector, low-pass filter (LPF)l 116 and divider 1 120, is 
used to stabilize the output of a nominal 1.16 GHz voltage controlled oscillator (VCO) 1 1 18 by 
locking it to the XO reference carrier. The stabilized VCO output is phase modulated by a linear 
modulator 1 128 with range -n/5 to n/5. The VCO output is then applied to a x5 frequency 
multiplier 1 130. The multiplier 1 130 output is filtered by band pass filter (BPF) 1 132 to remove 
undesired harmonics. The modulating signal is generated by integrating at integrator 1 124 the 
controller 1 122 output waveform, and then filtering it at Gaussian low pass filter (GLPF) 1 126 
having a bandwidth-time product 0.3. Controller 1 122 periodically generates a data packet 
consisting of a synchronization header and a tag ID, both spread by a 10 Mbps pseudo-noise 
code. The waveform is transmitted at tag antenna 1 134. 

[00096] FIG. 12 is a functional block diagram of a second tag embodiment for the first system 
embodiment. In this embodiment the crystal oscillator (XO) 1212 generates a reference clock. A 
phase- lock- loop (PLL), consisting of a phase/frequency detector, low-pass filter (LPF) 1216 and 
divider 1220, is used to stabilize the output of a nominal 5.8 GHz voltage controlled oscillator 
(VCO) 1218 by locking it to the XO reference clock. The stabilized VCO output is phase 
modulated by a linear modulator 1228 with range -tt to rc. The modulator output is filtered at 
band pass filter (BPF) 1230. The modulating signal is generated by integrating at integrator 
1224 the controller 1222 output waveform, and then Gaussian low-pass filtering it at Gaussian 
low pass filter (GPLF) 1226 with bandwidth-time product 0.3. Controller 1222 periodically 
generates a data packet consisting of a synchronization header and a tag ID, both spread by a 10 
Mbps pseudo-noise code. The waveform is transmitted at tag antenna 1232. 

[00097] FIG. 13 is a circuit schematic of a first implementation of tag controller 1 1 12 or 1222. 
The 10-MHz tag clock 1312 is divided by 41667 by clock divider 1314 to generate the 240 Hz 
packet clock. The packet clock sets the enable latch 1316 which allows the 10 MHz clock signal 
to pass through the AND gate 1318, and enables the transmitter. The gated 10 MHz clock is 
divided at clock divider 1320 by 640 clocks to reset the enable latch and disable the transmitter 
after the packet transmission has been completed. 
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[00098] The gated 10 MHz clock is used to shift the 19-stage shift register 1328. This shift 
register is initialized to OEEDA hex (0001 110111011011010 binary) at the start of each packet. 
The outputs from the 1 st , 2 nd , 5 th , and 19 th stages are input to an exclusive-or (XOR) gate 1330. 
The gate output is then input to the first stage of the shift register. The shift register output, the 
output of the 19 lh stage, is applied to the output exclusive-or (XOR) gate 1338. 

[00099] The gated 10 MHz clock is divided by 10 at clock divider 1322 to form a 1 MHz clock. 
This clock is used to drive a 6-stage (divide by 64) counter 1324. The three MSB's of the counter 
state are used to address an 8 x 8 ROM 1334, which contains the packet data. The addressed 8- 
bit ROM data is applied to an 8-to-l MUX 1332. The three LSB's of the counter state are used to 
select the MUX output. The MUX output is reclocked by the 10-MHz gated clock via D flip-flip 
1336, and then applied to the output exclusive-or (XOR) gate 1338. 

[000100] FIG. 14 is a circuit diagram of a second possible implementation, 1122' or 1222', of 
tag controller 1 122 or 1222. The 10-MHz tag clock 1412 is divided by 41667 at clock divider 
1414 to generate the 240 Hz packet clock. This packet clock resets a 10-stage (divide by 1024) 
counter 1424. The counter state NOT 640 is decoded and used to gate the 10 MHz clock and to 
enable the transmitter. The gated 10 MHz clock is used to clock counter 1424. When the counter 
state reaches 640, the gated clock is disabled, stopping the counter 1424, and the transmitter is 
disabled. The seven MSB's of the counter state are used to address a 128 x 8 ROM 1434, which 
contains the 640 bits of spread packet data. The addressed 8-bit ROM data is applied to an 8-to-l 
MUX 1432. The three LSB's of the counter state are used to select the MUX output, which 
provides the controller output. 

[000101] FIG. 15 is a functional block diagram of one of the sensors 42. The sensor receives 
the 5.8-GHz signals from the tags via receiver antenna 1512, bandpass filters them at bandpass 
filter 1514 to remove interference, and low noise amplifies them through amplifier 1516 to set 
the receiver noise floor. The low noise amplified signals are then bandpass filtered again at band 
pass filter 1 5 1 8 to limit the noise power, and converted into in-phase and quadrature-phase 
baseband signals 1522 and 1524, respectively. The baseband signals are low pass filtered at low 
pass filters 1536 and 1538, amplified at amplifiers 1540 and 1542, and sampled and quantized at 
analog-to-digital converters 1544 and 1546. Note that the conversion clocks for analog-to-digital 
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converters 1544 and 1546, which constitute the receiver clock, are not synchronized to any of the 
transmitters 1 clocks or to any of the other receivers' clocks. The digital in-phase and quadrature- 
phase samples are multiplexed at multiplexer 1548 into a single data stream which is applied to a 
bank of correlators 1550. The correlators determine parameters that are converted into the most 
likely tag ED, code phase, and carrier phase by the digital signal processor (DSP) 1552. These 
estimates are then output to the 100Base-T Ethernet interface 1554 for transfer to the processing 
system 62. 

[000102] FIG. 16 is a functional block diagram of processor 62 for processing received tag 
signals. The data on the 100Base-T interfaces 1612 from the various sensors 42 is input to the 
measurement processor 1614, which converts the code and carrier phases into position estimates. 
The estimates are output via a lOOOBase-T Gigabit Ethernet interface 1616. 

[000103] Processor 62 uses the code and carrier pseudorange measurements from sensors 42 to 
determine the tag positions at the sampling instants. Raw position information is then output. All 
positions are relative to the reference tag 50. Of course, when the position of the reference tag 
50 is known, the positions relative to any arbitrary reference point or tag within the capture zone 
can be computed using known coordinate transformation algorithms. The code pseudorange 
measurements are processed as previously described to provide a code phase measurement which 
provides a rough position estimate. This rough estimate is used to bound the ambiguity search, 
and carrier pseudorange measurements are processed to obtain the final position estimate. That 
is, the code phase determination provides a rough estimate of position, and the carrier phase 
determination provides a fine position determination within the rough estimate. Code phase and 
carrier phase measurements are themselves known within the art and described in the literature. 

[000104] The code pseudorange measurement error standard deviation is given by: 



c 




where R is code rate (10 Mcps) 



T is measurement duration (48 bits / 1 Mbps = 48 x 10~ 6 s) 
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C/No is carrier-to-noise density ratio (68 dB-Hz @ threshold) 
This gives a value of a CO de = 1,724 mm, or a Do ubieDiff = ^4 x a CO de = 3,448 mm. 

[000105] The other code pseudorange position error sources are a 1 m sensor position error, and 
a 1 m multipath error which requires some form of mitigation to achieve. The remaining error 
sources are small, including sensor antenna phase center variation, and the atmospheric 
refraction. The error budget is shown in Table 2. 



Table 2 - Code Pseudorange Position Error Budget 



Error Source 


1a Error 


Measurement 


3,448 mm 


Sensor Position Error 


1,000 mm ; 


Multipath 


1,000 mm ; 


RSS Error 


3,727 mm 


Max 8-Sensor PDOP in Capture Zone / V3 


x 0.96 


1a Position Error per Axis 


3,578 mm 



[000106] The carrier pseudorange measurement equation is 
where 

N,^ is the integer number of cycles between tag A and sensor i at a reference time 

$\ A is the fractional phase at the reference time plus the accumulated measured phase 
change since the reference time (cycles) 

X is the carrier wavelength (meters/cycle) 

[000107] Double differences can be formed similarly to code pseudorange measurements as 

S$* (n) = A [Stf (n) - S<f>« (n) - Stf (n) + 8$ («)] = 

-w+ i«j i + y («) y m — sNf* 
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where 

6Nij AR = ^[Ni A - Nj A - N R + Nj R ] 

[000108] If the 5Njj AR are known, then the direct, least squares, and extended Kalman filter 
solutions, and associated PDOP and fault detection and isolation algorithms discussed in the 
section entitled Processing Algorithms, are applicable. If the integers are unknown, they can be 
eliminated by forming triple differences, by differencing the double differences between two 
epochs 

S$«(n 9 n + l) = 5$«(n)-S$«(n + l) = 

|r A O) - s, | - |r A (n) - s. J - |r A (n + 1) - s. | + |r A (n + 1) - s. J 

[000109] The six unknowns are the marker tag A position vectors at time epochs n and n+1, 
r A (n) and r A (n+l). Measurements from seven sensors at these two time epochs are required to 
form the six independent triple differences required to obtain six independent equations in these 
six unknowns. These equations can be linearized around an approximate solution, either from a 
previous epoch or from the code pseudorange solution, and the resulting linear equations solved 
for the marker tag A coordinates. 

[0001 10] For (M+l) Sensors, M > 6, and linearization around an approximate solution, [r°(n), 
r°(n+l)] the generalized least squares solution is: 



x A (n) = x°(n) + 5x ^ 



where 



x A (n) = 



r» 

r A (n + l) 



x°(«) = 



r» 
r°(n + l) 



8x A = (H n T H n )"'H n T 5z 
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dz = 



SPR£(n,n + l)- 


|r°(«)-s 0 


-|r°(n)-s, 


-|r°(« + l)-s 0 


+ |r°(« + l)-s,| 


8PR**{n,n + \)- 


r°(«)-s,| 


-|r°(n)-s 2 


-|r°(« + l)-s, 


+ |r°(/j + l)-s 2 | 



SPK R MAn>n + \)-\r\n)-% M -r°(»)-s M+1 - r°(« + l)-s M + r 4 (« + l)-s 



M + l 



H„ = 



a^ 2 (/j) 



«<,(*) 



-«<,(« + 1) 

-orA-,^// + 1) 



-a^,(« + l) 
-a^,(« + l) 



-az^C/i + 1) 



[0001 11] The least squares solution only exists if rank(H n ) = 6. A necessary condition is that 
marker tag A has moved between epochs n and n+1. Otherwise, the last three columns of the 
observation matrix H are the negatives of the first three, and rank(H) < 3. Since it is unlikely that 
the tag will have moved sufficiently during a single epoch to provide good observability, it is 
either necessary to use two epochs sufficiently spaced in time, or to determine the 5Ny AR . 

[0001 12] One option is to use the double differences and estimate the double difference integers. 
Each double difference is a function of the three marker tag A coordinates and its double 
difference integer number of cycles. Thus for (M+l) sensors we have M equations in M+3 
unknowns. This is an underdetermined problem. For (M+l) sensors and L epochs, we have L x 
M equations in M + 3 x L unknowns. So, with 2 epochs (L = 2) we need measurements from 7 
sensors (M = 6). Similarly, with 4 epochs (L = 4) we need measurements from 5 sensors (M = 4). 
Unfortunately, these systems of equations suffer from the same observablity concerns as the 
triple difference system. Significant tag A motion is required between epochs. However, since 
now we are estimating the 8Ny AR , consecutive epochs are not required. 

[0001 13] For 2 epochs, n and n+k, and for (M+l) sensors, M > 6, and linearization around an 
approximate solution, the generalized least squares solution is: 



x A (n) = x°(n) + Sx A 
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where 



x\n) = 



r A (n) 




' r°(n) ' 


r A (n + k) 




r°(n + k) 


SNS 




*< 


SNf* 


x"(n) = 


Ml 


• 




• 


• 




• 


8N AR 







8x A =(H n T H n )- 1 H n T 8z 



8z = 
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[0001 14] One approach for using this algorithm is to perform a Marker Tag Double Difference 
Integer Calibration (MTDDIC). The Processor 62 is placed in MTDDIC mode. The reference tag 
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50 and marker tags 52 are placed in the capture zone. The marker tags are then moved around 
inside the capture zone, either in a predetermined MTDDIC pattern or until the Processor has 
observed sufficient motion based on processing of the code pseudorange measurements to 
guarantee good observability for the double difference integers. In the later case, the processor 
indicates when sufficient motion has been observed for each of the marker tags. In both cases, 
the state estimate is calculated as described above. Once the 5Njj AR are known, as long as each 
sensor maintains phase lock on each Tag signal, the algorithms discussed in the section above 
entitled Processing Algorithms can be used to process the double difference phases. 

[0001 15] In another approach that does not require a calibration mode, the Processor stores the 
double difference phase measurements until it has determined the 5Nij AR values, then processes 
them using the algorithms discussed in the Processing Algorithms section above to solve for the 
time history of marker tag positions. The processor waits until sufficient motion based on 
processing of the code pseudorange measurements has occurred to guarantee good observability 
for the double difference integers. Then it solves for them. Once the integers have been resolved, 
position estimates are generated in real-time using the algorithms discussed in the Processing 
Algorithms section to process the double difference phases. This approach is also applicable after 
MTDDIC if phase lock is lost on one of the tags or sensors. 

[0001 16] Still another approach is to use an extended Kalman filter. The time update and 
measurement update equations are identical to those described in the Processing Algorithms 
section. The differences in the state equation and measurement model are: 




r(k) is the 3 x 1 marker tag position vector 



v(k) is the 3x1 marker tag velocity vector 



a(k) is the 3 x 1 marker tag acceleration vector 



n is the M x 1 vector of double difference integers, 5Njj 



AR 



Attorney Docket No. MENAH-66588 -33- 



<D = 



1 


0 


0 


AT 


0 


0 


AT 2 /2 


0 


0 


0 


• 


0 


0 


1 


0 


0 


AT 


0 


0 


AT 2 /2 


0 


0 


• 


0 


0 


0 


1 


0 


0 


AT 


0 


0 


AT 2 /2 


0 


• 


0 


0 


0 


0 


1 


0 


0 


AT 


0 


0 


0 


• 


0 


0 


0 


0 


0 


1 


0 


0 


AT 


0 


0 


• 


0 


0 


0 


0 


0 


0 


1 


0 


0 


AT 


0 




0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


0 


• 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


0 


• 


0 


0 


0 


0 


0 


0 


0 


0 


0 


1 


0 


■ 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 








• 


• 


• 


• 


• 


• 


• 


• 


• 




I M 




0 


0 


0 


0 


0 


0 


0 


0 


0 


















rr 






i r 




1 


r 



Q = £[w«w(tf]=a 



0. 



y 6.t3 



L 

r 

L 

r 

L 



o 



3x6 



J L 

i r 

J L 



o 



Mv9 



J 
1 

J L 

i r 

J L 



5z(/t) = 



8PR£ (k) + |s 0 1 - |s, | - |r° (/c) - s 0 1 + |r° (*) - s, | + 8N£ 
8 PR** (k) + |s, | - |s 2 1 - |r° (k) - s, | + |r° (k) - s 2 1 + 8Nf. 



AR 

2 



Attorney Docket No. MENAH-66588 -34- 



H> = 



ax^(k) 



<*y A 0 ,(k) 
ay&k) 



«<,(*) 
az^(k) 



M 



<*xt, M+i (k) ay A MM+x (k) az A MM+l (k) 



R = E[\(k)v(k) T ] = 4a 



1 


- 1/ 

72 


0 • 


• 0 


0 


- V 

72 


1 


~Yi • 


• 0 


0 


0 


- V 

72 


1 • 


• 0 


0 


• 


• 


• • 


• • 


• 


• 


• 


• • 


• • 


• 


0 


0 


0 • 


• 1 


- 1/ 

/2 


0 


0 


0 • 


# "72 


1 



gpr is the carrier phase pseudo-range standard deviation (nominally 0.00025 m) 

[0001 17] The state covariance matrix, P> is initialized based on the uncertainty in each marker 
tag's position. The code pseudorange solution provides a nominal uncertainty of 3.5 meters per 
axis. 

[0001 18] Since the marker tag position outputs from the system can be up to 100 ms delayed, a 
fixed-lag optimal smoother can be used to determine the tag positions. 

[0001 19] Numerous approaches have been described in the literature for GPS ambiguity 
resolution; they are generally applicable to resolving the double difference integers with minor 
modifications. These include system identification, particle filtering, least squares ambiguity 
decorrelation adjustment, fast ambiguity resolution approach, fast ambiguity search filters, 
genetic algorithms, and interfere nonlinear programming methods. 



[000120] The carrier pseudorange measurement error standard deviation is given by 



earner 



where 



V 5 w. 



1kF.\tC/^ 
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c is speed of light (3 x 10 8 m/s) 
F is carrier frequency (5.8 GHz) 

T is measurement duration (48 bits / 1 Mbps = 48 x 10" 6 s) 

C/N 0 is carrier-to-noise density ratio (68 dB-Hz at threshold) 

[000121] The resulting a C amer is 0.47 mm at threshold, 0.24 mm at 73.7 dB-Hz C/N 0 , and 0.024 
mm at 93.4 dB-Hz C/N 0 . 

[000122] The carrier pseudorange measurements must be corrected for the radio refractive index. 
Range is related to propagation time by the speed of light, i.e., the range from a to b is equal to 
the speed of light times the propagation time from a to b. The speed of light in a vacuum is c == 
2.997924 5 8 x 10 8 m/s. In atmosphere the speed of light is c / (1 + N x 10" 6 ) «cx(l-Nx 10" 6 ) 
where N is the radio refractivity (N-units) which can be estimated as 

( £L ^ 

10(7 + 273) 



T + 273 



where T is the atmospheric temperature (°C) 

P is the atmospheric pressure (hPa) 

H is the relative humidity (%) 

(a, b, c) are equal to (6.1121, 17.502, 240.97) for -20 °C < T < +50 °C, and equal to 
(6.1 115, 22.452, 272.55) for -50 °C < T < -20 °C. 

[000123] The estimation error is less than 5%. Table 3 shows the corrections required for a 
150 m path for various atmospheric conditions. 
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Table 3 - Correction Required for 150 m Path 



Atmosph re 
M d I 


T mp 

(°C) 


Pressure 
(hPa) 


Humidity 

(%) 


Corr ction 
(mm) 


Standard 


15 


1013 


58 


47.7 


Dry 


15 


1013 


0 


40.9 


Low Lat 


27 


1012 


76 


56.2 


Mid Lat 
Summer 




IU IO 


74 
I *f 


oz.o 


Mid Lat 
Winter 


0 


1019 


72 


46.7 


High Lat 
Summer 


14 


1008 


74 


48.9 


High Lat 
Winter 


-16 


1011 


83 


47.0 | 



[000124] The carrier pseudorange measurement multipath error is given by 

& MULTIPATH ~ ~ 4 L J tan ~ 77T aU 

where 

X is carrier wavelength 

a is the product of the reflection coefficient and the code correlation (0 to 1) 

[000125] FIG. 17 shows the calculated carrier phase multipath error as a function of the 
reflection coefficient. 

[000126] A variety of techniques is available for multipath mitigation, including without 
limitation: circularly polarized signal; good axial ratio sensor antennas; choke ring sensor 
antennas; digital processing at sensor; multi-element sensor antennas; RF absorbent sensor 
ground plane; and higher carrier frequency. 

[000127] Other error sources are the sensor antenna phase center variation and the sensor 
position error. Phase center varies as a function of the signal arrival angle at the antenna. At 5.8 
GHz variations of 2 to 5 mm are expected. Each sensor antenna is calibrated for phase center 
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variation as a function of signal arrival angle, and these calibration values are subtracted out of 
the measurements. A 10% modeling error leaves a 0.2 to 0.5 mm residual error. 

[000128] The sensor positions are preferably measured to sub-millimeter accuracy using the 
following procedure: 

1) Install the sensors with rigid supports. 

2) Switch all of the sensors to calibration mode. 

a) Deactivate the sensor receivers. 

b) Radiate tag like signals from the sensor receivers. 

3) Install the reference tag with rigid supports and activate. 

4) Place the calibration receiver at several known positions relative to the reference 

tag. 

5) Collect the data at each position. 

6) Process data to determine the sensor positions relative to the reference tag. 
[000129] Other calibration procedures are possible as will be apparent to those skilled in the 
relevant art. 

[000130] A carrier pseudorange position error budget is shown in Table 4. A simulation has 
been used to validate the design. 

Table 4 - Carrier Phase Position Error Budget 



Error Source 


1a Error 


Measurement 


0.24 - 0.47 mm 


Sensor Position Error 


0.3 mm 


Radio Refractive Index 


0.3 mm 


Multipath 


0.3-3.0 mm 


Sensor Antenna Phase Center Variation 


0.2 - 0.5 mm 


RSS Error 


0.61 - 3.11 mm 


Max 8-Sensor PDOP in Capture Zone / 


x 0.96 


1a Position Error per Axis 


0.56-2.99 mm 



[000131] Correlation matched filters are used to obtain time, frequency, and phase 
measurements. The correlation processing is performed at two levels. First, correlation with the 
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sync field of the tag waveform is used for time and frequency synchronization. This correlation 
must be performed at frequencies that cover the range of possible Doppler shifts and oscillator 
offsets. The frequency range is divided into frequency bins, and correlation is performed at the 
center frequency of each bin. Since all of the tags have the same sync field, the sync correlation 
detects all of the tags seen by each sensor. 

[000132] After a tag has been detected and its received frequency bin identified, correlation with 
the ID field is used to obtain code phase measurements and carrier phase measurements. The 
code phase measurements are generated by interpolating between the 100 nsec correlation 
samples to find the peak correlation value. The carrier phase measurements are generated by 
computing the argument of the interpolated peak correlation value. 

[000133] FIG. 18 shows the correlation bank functional processing within processor 62 and its 
correlation bank 1550. Each pair of 10 million sample per second (MSPS) 8-bit in-phase (I) and 
8-bit quadrature-phase (Q) samples are input to a FIFO (first in, first out) register 1812. The 
sample pair is stored as a 16-bit word. FIFO 1812 is 800 words long. At a rate of 62. 5 -kHz, 
corresponding to 160 new words being input to the FIFO, the FIFO contents are copied to a 800 
word buffer. The 320 words corresponding to the oldest 320 words in the FIFO are copied from 
the buffer. This copy block is expanded from 320 words to 480 words by padding with 160 
words consisting of all zeros. The zero padding is appended to the block next to the newest of the 
320 words from the FIFO. The padded block is input to a 480-point complex Fast Fourier 
Transform (FFT) section 1814. The 8-bit I sample is treated as the real part and the 8-bit Q 
sample as the imaginary part. The FFT is a fast implementation of the discrete Fourier transform 
(DFT), which is the discrete version of the continuous time Fourier transform. 

[000134] The FFT output is multiplied by a reference sync sequence 1818 at multiplier 1816. 
The 480 word reference sync sequence is precomputed and stored in a memory chip. The same 
reference sync sequence is used by all sensors. The reference sync sequence is generated by 
computing the complex FFT of a padded sequence and taking its complex conjugate (i.e. 
changing the algebraic sign of the Q part). The first 160 words of the padded sequence consist of 
the 160 words obtained by complex sampling the ideal sync waveform at 10 MSPS. The 
remaining 320 words consist of zero padding, i.e. words that are all zero. 
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[000135] Complex multiplication is used as follows: 

I M = If x I c - Qf x Q c 

Qm = IfxQc + I f xQ c 

where Im and Qm are the multiplier outputs 

If and Qf are the FFT output 

Ic and Qc are the precomputed outputs from the reference memory chip. 

[000136] The multiplication is performed element by element, i.e. the first word of the FFT 
output block 1814 is multiplied by the first word of the precomputed reference 1818, the second 
word by the second word, etc. 

[000137] The result of the multiplication is a 480 word vector of complex numbers. This vector 
is input to a 480-point IFFT (inverse FFT) function 1820. The output of the IFFT is another 480 
word vector of complex numbers. The magnitude of each of these numbers is computed by 
taking the square root of the sum of the squares of the I and Q values. The resulting 480 
magnitudes are examined for peaks. Each peak corresponds to a tag sync field contained in the 
320 words from the buffer, and the location of the peak identifies the start of the tag packet. 

[000138] Since the sync field is contained within the last 320 words of the buffer, the tag ID 
field must be fully contained within the buffer. For each correlation peak identified by the sync 
correlation, 482 words are copied from the buffer corresponding to the predicted location of the 
480 word ID field plus one word on each side. The center 480 words of the copy block are 
correlated (using element by element complex multiplication) at block 1824 with each of the 
possible tag ID reference sequences. The 480 word reference ID sequences are precomputed and 
stored in a memory chip such as tag ID waveform EEPROM 1822. The same set of reference ID 
sequences is used by all sensors. The reference ID sequences are generated by complex sampling 
an ideal ID waveform at 10 MSPS. 

[000139] Initially, the number of "possible tag ID reference sequences" is equal to the number of 
tags in the capture zone. Once a given sensor has detected a packet from tag A at time T A > as 
measured by the sensor's clock, it knows that the next packet from tag A will arrive at time T A + 
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4167 jxsec with maximum uncertainty of ±417 jisec due to tag A clock offset (100 ppm) and 
motion. After the sensor has detected several packets from tag A, it can isolate the arrival of the 
next packet from tag A to a specific buffer. Then the average number of "possible tag ID 
reference sequences" is (240 x number of tags in capture zone / 62,500). 

[000140] The result of the correlations is one complex value for each possible tag ID reference 
sequence. The tag ID corresponding to the peak correlation value is used to determine which tag 
sent the packet. Two additional correlations are computed using the identified tag ID reference 
sequence, one with the first 480 words of the copy, and the other with the last 480 words of the 
copy. The magnitude and phase represented by each of these numbers is computed by taking the 
square root of the sum of the squares of the I and Q values, and by taking the arctangent of the Q 
value divided by the I value, ATAN(Q / 1), respectively. Interpolation of the magnitude values is 
used to estimate the correlation peak; this value is the code phase measurement. Once the 
correlation peak has been identified, the phase values are interpolated to the same instant in time; 
the resulting value is the carrier phase measurement. 

[000141] A mathematical description of the sync correlation processing follows. The received 
waveform complex samples are denoted by s w (n), where n = 0 to 319, and the reference 
waveform complex samples are denoted by r w (n), where n = 0 to 159. Padded complex sample 
sequences, s and r, are generated as follows: 

s(k) = 0 for k = 0 to 159 and s(k) = s w (k - 160) for k = 160 to 479 

r(k) = r w (k) for k - 0 to 159 and r(k) - 0 for k = 160 to 479 

Then the processing proceeds as follows: 

S is computed as the Fast Fourier Transform (FFT) of s 

R is computed as the FFT of r 

R* is computed as the conjugate of R 

D is computed as the element by element product of S and R*, D(k) = S(k) x R*(k) 

The correlation vector, C, is computed as the inverse FFT of D 
[000142] The TI TMS320C6713-200 DSP microcircuit, available from Texas Instruments 
Incorporated ("TI") of Dallas, Texas, is used in the exemplary embodiment for the sensor 
processing. Taking advantage of TI's TMS320C67x DSP library and using single precision 
floating point, the required number of clock cycles for Sync Correlation is shown in Table 5. 
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Since each DSP provides 200 million clocks per second, a total of 7 processors are required for 
each sensor. The processors are operated in parallel, each processing one sample buffer until 
each of them has been utilized, by which point the first processor will be free and the cycle 
repeats. So, each processor processes every 7 th sample buffer. 



Table 5 - Sensor DSP Sync Correlation Processing Requirements 



Processing Step 


Required Cycles 


Compute 512-point complex FFT of 
buffered samples [2 x n x log2(n) + 
42] 


9258 


Complex multiply FFT output with 
the 512-point stored sync reference 
complex waveform [4 x n + 33] 


2081 


Compute complex IFFT of multiply 
output [2 x n x log2(n) + 42] 


9253 


Compute magnitude squared of IFFT 
outputs [2 x n +22] 


1046 


Locate values above threshold [2 x n / 
3 + 13] 


355 


TOTAL 


22,011 




x 62,500 




1376 Mcps 



[000143] Once the sensors are tracking the tags, the tag ID correlation processing consists of 
three 480-point complex correlations and computation of the interpolated peak value and phase 
for each packet from each tag. The required number of clock cycles for ID Correlation is shown 
in Table 6. For 5,000 Tags in the capture zone and 240 packets per second, 37 processors are 
required. 



Table 6 - Sensor DSP ID Correlation Processing Requirements 



Processing Step 


Required Cycles 


480-point complex correlation with 
stored sync reference complex 
waveform [4 x n + 33] 


1953 


Factor for correlations with three 
offset values 


x3 


Sub-Total 


5859 
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Interpolate three offset complex 
correlation values 


144 


Sub-Total 


6003 


Packets per Tag times # of Tags 


x 240 x 5000 


TOTAL 


7,204 Mcps 



Second System Embodiment 

[000144] A second system embodiment is similar to the first system embodiment, but uses some 
different techniques. The second system embodiment has generally been determined to be 
slightly preferred over the first system embodiment and is therefore considered to be a second 
generation design. 

[000145] The capture zone is a rectangular parallelepiped with maximum diagonal up to 150 
meters. The system captures tag positions anywhere within this capture zone. The system 
operates with any number of sensors 42 from 4 to 32. The sensors are placed such that the 
distance between the front of a sensor and the capture zone is between 5 percent and 15 percent 
of the maximum diagonal of the capture zone. 

[000146] The buffer zone for each sensor is the volume defined by a plane tangent to the capture 
zone at its closest point to that sensor and a parallel plane twice the setback distance of that 
sensor away from the capture zone. Tags are excluded from the buffer zone. The system is 
capable of capturing 1,000 tags within the capture zone. The system is capable of capturing tags 
with dynamics of 45 m/s velocity per axis, 45 m/s 2 acceleration per axis, and 45 m/s 3 jerk per 
axis. 

[000147] The tag positions are provided in X, Y, Z coordinates relative to the location of fixed 
reference tag 50. The orientation of the coordinate frame is determined during calibration. The 
tag position outputs have no more than 0. 1 second latency. Positions for each tag are output at a 
rate of N times per second, where N is selectable from the set {1, 2, 3, 4, 5, 6, 8, 10, 12, 15, 16, 
20, 24, 30, 40, 48, 60, 80, 120, and 240}. 

[000148] For any two tags A and B, which may be the same tag, and at any two times U and t 2 , 
which may be the same time, the 1-g per axis error in the reported position of tag A at time tj 
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relative to the reported position of tag B at time t2 does not exceed the following; provided that 

the position dilution of precision (PDOP) of each of the reference tag 50, the A tag, and the B tag 
calculated using only those sensors with clear line-of-sight to the tags, does not exceed 1.73: 

e = 1 mm + F V (V AB ) + F T (t 2 - + F D (6 AB ) 
where 

Vab = MAX[V A (t!), V A (t 2 ), V B (t!), V B (t 2 )] 
Vx(tk) is the actual velocity of Tag X at time tfc 

5AB = |PA(tl)-PB(t2)l 

PxOk) * s the actual position vector of Tag X at time tfc 
If v < 1 m/s then Fy(v) = 0 mm, else Fy(v) = 1 mm x v / (1 m/s) 
If t < 21,600 sec then F T (t) = 0 mm, else F T (t) = 1 mm x t / (21,600 s) 
If d < 3 m then Fj)(d) = 0 mm, else Fj)(d) = 1 mm x d / (3 m) 
[000149] The tag position outputs have a precision of 0.1 mm, or better. 

[000150] The system outputs are provided on a lOOOBase-T interface. They are broadcast using 
UDP to port 3030 on IP multicast address 214.0.0.2. One UDP packet is generated for each tag at 
the selected output rate with the format shown in Table 7. 
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Table 7 - Output Packet Format 



Field 


#of 
Bytes 


Format/Coding 


Description 


Time_Code 


8 


IEEE 64-bit integer, 
Microsoft DateTime 
format 


Reference time 
Tor position 


Tan in 


q 
o 


8 character ASCII hex 
string 


oo hit Too in 
oz-Dii i ag iu 


X_Position 


8 


IEEE double precision 
floating point 


Relative X 
position 


Y_Position 


8 


IEEE double precision 
floating point 


Relative Y 
position 


Z_Position 


8 


IEEE double precision 
floating point 


Relative Z 
position 


Quality Factor 


2 


IEEE 16-bit integer 


Position quality 



[000151] The tags transmit in the 5725 MHz to 5875 MHz band. It is divided into 15 channels 
with center frequencies of 5730 + n x 10 MHz, n = 0, 1, . . 14. Up to 1,000 tags are deployed in 
each channel, for a total capacity of 15,000 tags in the band. 

[000152] The tags transmit 400-bit packets. Each tag designed to operate on a given frequency 
channel is assigned a unique 400-bit pattern obtained as a substring of a long maximal length 
sequence (PN-sequence). To accommodate 1,000 tags, a minimum sequence length of 400,000 
bits is required. This is provided by a SSRG with 19 or more stages and appropriate feedback 
taps. Alternatively, a family of codes with good cross-correlation properties, such as Gold codes, 
could be used. 

[000153] FIG. 19 shows the simple shift register generator used within the tag. The 1,000 400- 
bit patterns are generated from a SSRG with maximal length feedback polynomial x 19 + x 5 + x 2 + 
x and initial condition 07FFFF hex (1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 binary). Note that since 2 19 - 1 = 
524,287 is a Mersenne prime, all 19 degree irreducible polynomials over Z 2 result in maximal 
length sequences. Also, any initial condition, except all zeros, results in a maximal length 
sequence. The SSRG exclusive OR's the bits in the 19 th , 5 th , 2 nd , and 1 st stages to generate an 
input to the 1 st stage. The bits are then shifted one stage to the left. The bit in the leftmost stage, 
the 19 th , is output. The bit pattern for tag k is bits 400 x k through 400 x k + 399 of the output 
sequence, for k = 0, 1, 999. 
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[000154] The tag transmission signal modulation rate is 10 Mbps. Thus each time its 400-bit 
packet is transmitted, a tag bursts for 40 usee. The burst repetition rate is 50-Hz, so the time 
between bursts is approximately 20,000 jisec. Thus each tag has a 0.2% transmit duty cycle. 
There is intentionally no synchronization of the transmission clocks between the tags. This 
insures that the overlap between bursts from different tags, as seen at each of the sensors, is 
minimized. 

[000155] FIG. 20 is a functional block diagram of the tag. The 10-MHz crystal oscillator (XO) 
2012 generates a reference clock. A phase-lock-loop (PLL), consisting of a phase/frequency 
detector, low-pass filter (LPF) 2016, and divider 2020, is used to stabilize the output of a 
nominal 5.8 GHz voltage controlled oscillator (VCO) 2018 by locking it to the XO reference 
clock. The divide ratio is set to one of 573, 574, . . ., 587, corresponding to the desired frequency 
channel. The stabilized VCO output is BPSK modulated by modulator 2028 The modulating 
signal is generated by pulse shaping the controller 2022 output waveform with a raised cosine 
(RC) LPF 2025 with roll-off factor a - 0.35. The controller 2022 outputs the tag's 400-bit 
sequence at 10 Mbps, 50 times per second. 

[000156] FIG. 21 is a schematic diagram of one possible tag controller circuit. The 10-MHz tag 
clock 2112 is divided by 200,000 at divider 21 14 to generate the 50 Hz packet clock 2116. This 
packet clock sets the enable flip-flop 2118 and resets a 9-stage (divide by 512) counter 2122. 
The enable flip-flop state is used to gate the 10 MHz clock and to enable the transmitter via 
transmit enable signal 2132. The gated 10 MHz clock is used to clock the counter 2122. When 
counter 2122 reaches the 400-state, the enable flip-flop 21 18 is reset, disabling the gated clock, 
stopping the counter 2122, and disabling the transmitter. The seven MSB's of the counter state 
are used to address a 64 x 8 ROM 2124, which contains the 400 bits of packet data. The 
addressed 8-bit ROM data is applied to an 8-to-l MUX 2126. The three LSB's of the counter 
state are used to select the MUX output, which provides the controller output 2130. 

[000157] FIG. 27 is a side perspective view of a patch tag according to one possible patch tag 
embodiment. Tag 2710 is packaged as a stick-on patch, similar to those used for sustained drug 
release in humans. They are flat, flexible, approximately 40 mm in diameter, and comprise 
multiple layers. Those layers include a top protective layer 2712, an antenna layer 2714 
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including an antenna 2715 which may be a film or printed antenna, a circuit die layer 2716 
containing an ASIC circuit die or other circuitry, a battery layer 2718 containing a battery such 
as a printed battery, a protective layer 2720, and an adhesive layer 2722. Removable layer 2724 
may be a peelable paper layer or film layer covering and protecting the adhesive until the tag is 
ready to be used. When the device is ready to be used the user peels away removable layer 2724 
to expose the adhesive which then is used to attach tag 2710 to human skin, clothing, or some 
other surface. Removal of this backing 2724 also activates tag 2710 by closing the battery 
connection. In one embodiment the battery layer 2718 is a printed open cell battery providing 3 1 
mA/hr storage and 63 mA peak pulse discharge current at 1.5 VDC. The die on circuit die layer 
2716 may be a SiGe BiCMOS ASIC device incorporating both the RF and digital tag functions. 
With their 0.2% duty cycles, each tag 2710 can operate at the 63 mA peak pulse discharge 
current for 10 days. 

[000158] Removal of removable layer 2724 can activate tag 2710 in any of a number of different 
ways. Removable layer 2724 can include a tab extending inwardly from the plane of patch 
antenna 2710 and disposed between two spring loaded battery contacts, such that removing 
removable layer 2724 causes the tab to be withdrawn from between the contacts thus allowing 
the battery circuit to close and provide power to the device or otherwise activate it. This would 
be a normally open arrangement. A normally closed arrangement could alternatively be used, in 
which removable layer 2724 has a conductive portion which normally covers and therefore 
closes two electrical contacts through which a very low amperage current flows. When the 
removable layer is removed, the contacts are opened causing the device to sense the now-open 
circuit and respond by powering the remainder of the device and initiating transmissions. 

[000159] Other mechanisms for activating the device when it is ready to be used are possible. 
Removing removable layer 2724 having at least one opaque portion could expose a photodiode 
or other photoreceptor, causing the device to turn on. Removing the removable layer 2724 could 
also expose an oxygen sensor to the atmosphere causing the device to turn on. The tag 2710 
could come wrapped in a wrapper such as a foil wrapper, with removal of the wrapper causing a 
sensor on tag 2710 to be exposed to light, oxygen, or other environmental conditions thus 
activating tag 2710. Other methods of sensing are well known and could be used. 
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[000160] Tag 2710 can also provide visual, audio, or other feedback to indicate that it has been 
activated and to provide certain status information. For example, upon activation of the device a 
small light emitting diode (LED) could flash several times, or the device could beep several 
times, indicating that the device is now transmitting. Status information could also be provided 
in various ways. The LED flashing pattern or beep pattern could indicate that built in self test 
(BIST) has passed or failed, battery fully charged or low, or other conditions. BIST results and 
other diagnostic and status information could also be transmitted through the RF transmitter 
upon initial activation and/or periodically. 

[000161] FIG, 22 is a functional block diagram of a sensor 42 according to one embodiment. 
The sensor receives the 5.8-GHz signals via receive antenna 2212 from the tags, bandpass filters 
the signals at bandpass filter 2214 to remove interference, and low noise amplifies them at 
amplifier 2216 to set the receiver noise floor. The low noise amplified signals are then bandpass 
filtered again at band pass filter 2218 to limit the noise power, and downconverted at muliplier 
2224 to a 105-MHz IF signal. The IF signal is bandpass filtered at BPF block 2226 with an 8- 
MHz bandwidth, amplified at amplifier 2228, and sampled and quantized at A-to-D converter 
2230 at 20 Msps. The sample rate, F s , and IF frequency, Fi F , are selected such that 4 x Fi F = 
(2k+l) x F s , for some integer k. With F, F = 105-MHz and F s = 20 Msps, k = 10 and (2k+l) = 21. 
The digital samples represent alternating in-phase (I) and quadrature-phase (Q) samples as 
follows I, Q, -I, -Q. These samples are input to DSP 2232 where they are combined into 
complex samples and the alternating signs are corrected. DSP 2232 implements a correlation 
bank to determine parameters that are converted into the most likely tag ID, code phase, and 
carrier phase. These estimates are then transferred to the processing system via a 100Base-T 
Ethernet interface 2234. 

[000162] FIG. 23 is a sensor DSP processing functional block diagram. The 10 Msps complex 
samples 2310 are input to a FIFO register 2312. Each sample is stored as a 16-bit word. The 
FIFO is 600 words long. At a rate of 50-kHz, corresponding to 200 new words being input to the 
FIFO, the FIFO contents are copied to a 600 word buffer 2314. The buffer data is processed 
according to the sensor mode, Acquisition or Tracking. 
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[000163] In Acquisition Mode, the buffer is expanded from 600 words to 1024 words by padding 
with 424 words consisting of all zeros. The zero padding is appended to the block next to the 
newest of the words from FIFO 2312. The padded buffer is input to a 1024-point complex FFT 
section 2334. 

[000164] The FFT output is multiplied at multipliers 2336 in turn by each of the 1000 reference 
ID sequences. The 1024 word reference ID sequences are precomputed and stored in a memory 
chip. The same reference ID sequences are used by all sensors. The reference ID sequences are 
generated by computing the complex FFT of a padded sequence and taking its complex 
conjugate (i.e. changing the algebraic sign of the Q part). The first 400 words of each padded 
sequence consist of the 400 words obtained by complex sampling the ideal tag waveforms at 10 
Msps. These ideal tag waveforms include models of all tag components, such as filters, that may 
impact the transmit waveform, such that the stored waveforms approximate the idealized tag 
identification code waveforms as they would actually be received at the sensors. The remaining 
624 words consist of zero padding, i.e. words that are all zero. The results are stored in 
EEPROM 2332. 

[000165] Complex multiplication is used as follows: 

I M = If x I c - Qf x Q c 
Qm = If x Q c + If x Q c 

where I M and Q M are the multiplier outputs 
I F and Qf are the FFT output 

Ic and Qc are the precomputed outputs from the reference memory chip 

[000166] The multiplication is performed element by element, i.e. the first word of the FFT 
output block is multiplied by the first word of the precomputed reference, the second word by the 
second word, etc. 

[000167] The result of the multiplication is a 1024 word vector of complex numbers. This vector 
is input to a 1024-point IFFT (inverse FFT) section 2338. The output 2340 of the IFFT is another 
1024 word vector of complex numbers. The magnitude of each of these numbers is computed by 
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taking the square root of the sum of the squares of the I and Q values. The peak value, and 
corresponding index, is determined for each of the 1000 Tag reference sequences. If a peak 
exceeds a threshold, the corresponding Tag has been received. 

[000168] The magnitude and phase represented by each of these peak indices is computed by 
taking the square root of the sum of the squares of the I and Q values, and by taking the 
arctangent of the Q value divided by the I value, ATAN(Q / 1), respectively. Interpolation of the 
magnitude values is used to estimate the correlation peak; this value is the code phase 
measurement. The code phase measurement provides a course position estimate. Once the 
correlation peak has been identified, the phase values are interpolated to the same instant in time; 
the resulting value is the carrier phase measurement. The carrier phase measurement provides a 
fine position estimate within the bounds of the code phase measurement. 

[000169] A mathematical description of the Acquisition Mode processing follows. The received 
waveform samples are denoted by s w (n), where n = 0 to 599, and the reference waveform 
samples are denoted by r w (n), where n = 0 to 399. Padded sample sequences, s and r, are 
generated as follows: 

s(k) = 0 for k = 0 to 423 and s(k) = s w (k - 424) for k = 424 to 1023 
r(k) = r w (k) for k = 0 to 399 and r(k) - 0 for k = 400 to 1023 
Then the processing proceeds as follows: 

S is computed as the Fast Fourier Transform (FFT) of s 

R is computed as the FFT of r 

R* is computed as the conjugate of R 

D is computed as the element by element product of S and R*, D(k) = S(k) x R*(k) 

The correlation vector, C, is computed as the inverse FFT of D 

[000170] In Track Mode, for each packet expected to be in a buffer, the 400-words associated 
with that packet are correlated with three 400-word reference waveforms pre-stored in the 
sensor. The three reference waveforms correspond to the on-time packet and the packet shifted Vi 
bit early and V 2 bit late. The correlations are computed as complex vector dot products between 
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the 400-word vector extracted from the buffer and the on-time, early, and late pre-stored 
reference waveforms. Thus the Track Mode processing consists of three 400-point complex 
vector dot products and computation of the interpolated peak value and phase for each packet 
from each tag. 

[000171] The TI TMS320C67 13-200 DSP may be used for sensor processing. Taking advantage 
of TPs TMS320C67x DSP library and using single precision floating point, the anticipated 
required number of clock cycles is shown in Table 8, for 500 tags in the capture zone. Since each 
DSP chip provides 200 million clocks per second, a single chip is required for each sensor. 



Table 8 - Sensor DSP Tracking Processing Requirements 



Processing Step 


Required Cycles 


400-point complex correlation with 
stored sync reference complex 
waveform [4 x n + 33] 


1633 


Factor for correlations with three 
offset values 


x3 


Sub-Total 


4899 


Interpolate three offset complex 
correlation values 


144 


Sub-Total 


5043 


Packets per Tag times # of Tags 


x 50 x 500 


TOTAL 


126 Mcps 



[000172] FIG. 24 is a functional block diagram of the processor for processing received tag 
signals according to this embodiment. The data 2412 on the 100Base-T interfaces from the 
various sensors via sensor interfaces 2414 is input to the measurement processor 2416, which 
converts the code and carrier phases into position estimates. The estimates 2420 are output via a 
lOOOBase-T Gigabit Ethernet interface 2418. 

[000173] The processor uses the code and carrier pseudorange measurements from the sensors to 
determine the tag positions at the sampling instants. All positions are relative to the reference 
tag. The code pseudorange measurements are processed as described in the section entitled 
Processing Algorithms to provide a rough position estimate. This rough estimate is used to 
bound the ambiguity search, and carrier pseudorange measurements are processed to obtain the 
final position estimate. 
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[000174] The processor resamples the tag position measurements to match the required position 
output rate (1 Hz to 240 Hz), the processor takes advantage of the allowable 100 msec latency to 
smooth the positions as shown in FIG. 25. Even if the measurement rate and output rate were 
identical, resampling would be desirable since the tag transmit times are unsynchronized. 

[000175] FIG. 26 illustrates how the techniques described above can be used to create an 
extended capture zone. Extended capture zone 2610 includes a plurality of separate but 
overlapping capture zones 2612, 2614, and 2616. Sensors 2620 are placed between the 
individual capture zones. Sensors 2620 in the overlapping capture zone spaces are preferably 
not colinear or nearly colinear. 

APPLICATIONS 

[000176] The basic system described above can be used for a larger number of applications 
including motion capture for video games, television, cartoons, commercials, music videos, 
feature films, digital extras, digital stunts, and digital crowds. This invention provides many of 
the advantages of optical systems (extremely accurate, large number of markers, easy to change 
marker configuration, performers not constrained by cables, and large performance areas) 
without various disadvantages (extensive post-processing, expensive hardware, inability to 
capture occluded markers, and the need for a controlled environment). 

[000177] The motion capture tracking software receives the marker tag coordinates from the 
processor and processes them to reduce data noise as necessary. This reduction can be carried out 
by different methods, such as averaging various adjacent samples, limiting the maximum 
variations on the coordinates, or predicting positions based on history. Other noise reduction 
algorithms can be used for this purpose. After the reduction, the motion capture tracking 
software rebuilds unavailable data. This reconstruction is done by analyzing and completing 
existing trajectories. 

[000178] The biomechanical solver program takes the motion capture tracking software output 
data and builds the hierarchical structure that is used to recreate the subject's motion. This 
process combines the positions of up to 3 marker tags to recreate the rotations of a discrete part 
about its parent. The resulting hierarchical chain consists of a single global translation and a 
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series of rotations, such as, in the case of a human body, rotations for every limb about a local 
axis. The system then outputs the data generated by the biomechanical solver program. 

RF Match Moving 

[000179] The system can be used for match moving applications. Match moving is the 
automatic registration of 3-D virtual images with 2-D film or video images. The virtual camera 
from which the computer generated (CG) objects are viewed must closely match the actual 
camera position, rotation, focal length, and aperture. This can be achieved by using a motion 
control camera, which limits the directors' flexibility, or by tracking the camera in real-time. In 
both cases, the camera settings must be recorded. 

[000180] A minimum of 4 stationary reference tags are placed in the capture zone to establish 
the reference coordinate system. It is preferred that the tags are not coplanar or nearly coplanar. 
The angular accuracy is roughly equal to 1 1° divided by the separation distance between the 
reference tags expressed in centimeters. Thus for a 300 cm, 10 foot, separation, an angular 
accuracy of better than 0.05° can be achieved. 

[000181] FIG. 2 illustrates a camera having tags on it for the purpose of match moving. A 
minimum of 3 marker tags are attached to each camera to track its spatial position and rotation. It 
is preferred that the tags are not collinear or nearly collinear. The angular accuracy is roughly 
equal to 1 1° divided by the separation distance between the marker tags expressed in 
centimeters. Thus for a 30 cm, 1 foot, separation, an angular accuracy of better than 0.5° can be 
achieved. 

[000182] Stationary marker tags are placed in the capture zone to define coordinate frames for 
CG objects. Three tags are selected to lock the coordinate frame of each object. Additionally, 
CG objects can be locked to non-stationary "live" objects in the capture zone that have a 
minimum of 3 marker tags attached. In both cases, it is preferred that the three tags are not 
collinear or nearly collinear. 

[000183] Once the required reference tags and marker tags have been placed in the capture zone, 
attached to the cameras, and attached to desired live objects, the CG objects are combined with 
live action video as follows: 
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• Live action is recorded using a video camera. 

• All marker tags in the capture zone are tracked. 

• The focal length and aperture settings for the camera are recorded. 

• The RF Position Tracking System time code and the camera time code are 
recorded. 

• Each CG object is assigned 3 Tags for coordinate frame lock. 

• Each CG object is generated as it would have been captured by the video camera 
if it had been a "live" object. 

• All of the CG objects are combined with the "live" video and the composite 
rendered for display. 

[000184] Stationary tags which are visible to the camera can be used to correct camera lens 
distortions and other effects. 

Amusement Park/Mall/ Airport/Gathering Area Asset Tracking System 

[000185] The system can be used for asset tracking. Asset tracking captures the location and 
movement of people or other objects in any area such as an amusement park, mall, airport, or 
other indoor or outdoor location where there is likely to be a high density of people, animals, or 
other moving or static objects. Examples of its use include the ability to find lost children at an 
amusement park, and the ability to track the path used by people once entering an airport. A 
marker tag is attached to each asset. For children, the marker tag could be applied via a 
wristband or underneath clothing such that it would be unlikely that the child could or would 
remove the marker tag by himself. The system can find any one marker tag and/or trace its 
movement over time. Using the system, thousands of children could be instantaneously and 
simultaneously tracked with pinpoint accuracy throughout an amusement park or similar 
gathering. If an accompanying parent also carries a marker tag, the child and parent marker tags 
could be registered as a pair via scanning such that if the child were to leave the park without the 
parent close by, an alarm would sound and/or security would otherwise be alerted. The child 
would not be allowed to leave the parking lot or other outer perimeter until the possible 
abduction situation was resolved. 
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[000186] In the asset tracking system, the asset tracking software receives the marker tag 
coordinates from the processor and further processes them to reduce data noise as necessary. 
This reduction can be carried out by different methods, such as averaging various adjacent 
samples, limiting the maximum variations on the coordinates, or predicting positions based on 
history. Other noise reduction algorithms can be used for this purpose. After the reduction, the 
asset capture tracking software rebuilds unavailable data. This reconstruction is done by 
analyzing and completing existing trajectories. 

[000187] The tracing and capture program takes the asset tracking software output data and 
builds the hierarchical structure that is used to recreate the subject's motion and location at any 
given time. This data can be combined with maps, blueprints, GIS or other software that provides 
building/structure/environment detail. This combined data can then be monitored on computer 
systems and also streamed to PDA's and public kiosks. 

Golf Swing Analyzing Tool for Driving Ranges 

[000188] Applications for the position tracking system include the ability to capture the golf 
swing of any individual for replay and analysis. The system can be set up at a driving range 
where motion data is captured through the use of marker tags and sensors. The data is processed 
in real-time and displayed with high precision in realistic 3-D animation. This animation can 
then be viewed and manipulated in unlimited ways, providing insight and analyses into the 
individual's golf swing. The datasets from each swing can be saved and compared to 
professional golf swings, previous golf swings, etc. Body part movements, such as the rotation of 
one body part in relation to another, could be viewed in isolation. The subject could be 
represented by a series of wire frames, also providing focused analysis. In addition, datasets 
could be input into video games where the individual can use his/her actual swing and image in 
the game. Because the number of marker tags would be relatively small for such applications, 
the marker tag burst rate and hence the effective capture rate could be increased to well above 30 
frames per second, thus capturing the motion with what would amount to a frame rate of much 
faster than that of standard video recording apparatus. Because the dataset would be digital by 
nature, a computer system could provide instant quantitative and qualitative analysis. For 
example, immediately after a golf swing the processing system could inform the golfer that he is 



Attorney Docket No. MENAH-66588 



-55- 



over rotating his wrist by 10% just before ball impact, and provide a slow motion illustration of 
his wrist versus those of model golfer. 

[000189] Similarly, the system could be used to capture, analyze, and manipulate other sporting 
activity movements such as running strides, pitching motions, pole vaulting, and other activities. 

Industrial Applications 

[000190] In addition to the asset tracking discussed above, the system could also be used to track 
and analyze non-human movements, such as industrial processes including high speed industrial 
product manufacturing process in which precision coordinated movements of different parts at 
high speeds is required. The system would provide various advantages over high speed filming 
of industrial processes which has been used in the past to analyze such processes, including the 
ability to provide accurate distance, speed, and rotational measurements throughout the recorded 
sequence. 

Capturing Motion Data from Film Production or Sporting Events for Use in Video Game 
Production 

[000191] The precision tracking system can be used to capture motion for visual effects on film 
or television. The same datasets created on the film can be used for the development of lifelike 
motion mimicking those of the actors for video games. This data can be used with video game 
animation software to re-create actual body movement and interactions from the filming of the 
movie for the video game. 

[000192] The precision tracking system can be used to capture the motion of athletes, key 
personnel and objects during a live sporting event such as basketball or football games, and 
provide position data which can then be used to create 3-D animation for video games. In 
addition, game datasets captured by the precision tracking system can be downloaded and 
incorporated into existing video games for enhanced player experiences. This data is used with 
video game animation software to re-create actual body movement and interactions from the 
sporting event for the video game. 

Tracking Entire Sporting Events to Enhance Sports Broadcasts 
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[000193] The system could also be used to capture all the elements involved in a sporting event, 
including players, umpires/referees/field judges, players, equipment (balls, bats, clubs, etc.), and 
static objects important to the game in real-time. The motion data gathered by sensors could then 
be used to recreate live action using 3-D animation. This animation could then be used to provide 
accurate replay, analysis, virtual advertising, virtual imaging and interactive activities such as 
spectator controlled viewpoints via the Internet. 

[000194] Multiple marker tags could be attached on players and other objects to be tracked. 
Software would rebuild the images and merge them with animation to display an exact 
reproduction of the action that could be manipulated by an operator and broadcast on television 
or streamed online. 

Sports Performance Analysis and Reply Tool 

[000195] Applications for the position tracking system include the ability to capture, monitor and 
analyze the performance of athletes in real-time. During a performance, motion data is captured 
through the use of marker tags and sensors. This data is processed in real-time and displayed 
with high precision in photo-real 3-D animation. This animation can then be viewed and 
manipulated in unlimited ways, providing insight and analyses to an athlete's performance. 
Datasets and animated sequences can be used for decision making, for monitoring the medical 
condition of athletes, and for training purposes. 

[000196] Multiple marker tags could be attached on players and other objects to be tracked. 
Software would rebuild the images and merge them with animation to display an exact 
reproduction of the action that can be manipulated in unlimited ways by an operator. 

Full Body Video Game Controller 

[000197] The precision tracking system can be used to capture motion of a video game player 
that will, in real-time, control the action of a video game in the same way as existing handheld 
controllers do currently. Players play the video game with marker tags attached to their bodies 
while sensors capture their motion data and send it to the video game consol for processing and 
display. The player watches as his/her body movements are recreated on the screen. 
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[000198] Multiple marker tags would be attached on key points of the players 1 bodies such as 
wrists, ankles, and waists. The video game console would translate and render the action much 
like it would with existing video game controllers. 

[000199] As used herein, the term "radio frequency" (RF) is intended to encompass the spectral 
range from about 10 KHz to about 300 GHz, which includes microwaves. 

[000200] In the preceding discussion the reference tag has been characterized as fixed or 
stationary. It will be appreciated that the reference tag(s) need not be strictly stationary or fixed. 
Provided that the position of the reference tag can be determined, the reference tag will be 
understood to be fixed or stationary within the meaning of the invention. For example, if a 
reference tag were to be moved by a known or knowable distance and in a known or knowable 
direction, the distance and direction could be made known to, or otherwise determined by, the 
processing system. The processing system could then simply take that known movement into 
account and continue processing the tag pseudorange measurements accordingly to determine the 
correct relative and/or absolute positions of the marker tags being tracked. It is intended that the 
claims presented herein will cover such an insubstantial change to the preferred embodiment. 
Accordingly, the words "stationary" or "fixed" as used herein when referring to a reference tag 
are to be understood to cover not only absolutely stationary with respect to the earth's surface, 
but also located at a determinable position with respect to a desirable coordinate system even 
though that determinable position may move from one moment to the next. 

[000201] It will be also appreciated that the term "present invention" as used herein should not 
be construed to mean that only a single invention having a single essential element or group of 
elements is presented. Similarly, it will also be appreciated that the term "present invention" 
encompasses a number of separate innovations which can each be considered separate 
inventions. Although the present invention has thus been described in detail with regard to the 
preferred embodiments and drawings thereof, it should be apparent to those skilled in the art that 
various adaptations and modifications of the present invention may be accomplished without 
departing from the spirit and the scope of the invention. For example, other hardware 
architectures and microcircuit technologies can be used; variations on the algorithms can be 
used; different memory types can be used; different bit lengths, code words, and code types can 
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be used; different frequencies, frequency plans, modulation types, and transmission and 
reception techniques can be used. Accordingly, it is to be understood that the detailed 
description and the accompanying drawings as set forth hereinabove are not intended to limit the 
breadth of the present invention, which should be inferred only from the following claims and 
their appropriately construed legal equivalents. 



